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ABSTRACT 


The  Armed  Services  Vocational 
Aptitude  Battery  (ASVAB)  is  administered 
in  high  schools  and  postsecondary  schools  as 
a  part  of  the  Defense  Department’s  Student 
Testing  Program.  Until  1986,  high  school 
norms  based  on  a  national  sample  were  avail¬ 
able  for  grades  11  and  12  only.  These  were 
computed  from  data  collected  in  1980  as  a 
part  of  the  Profile  of  American  Youth  (PAY) 
study.  Additional  data  from  a  nonrandom 
sample  were  collected  in  1984  by  the  Military 
Entrance  Processing  Command  (MEPCOM). 
The  objective  of  the  present  study  was  to 
develop  norms  for  10th  grade.  Tenth  grade 
norms  were  developed  by  transforming 
MEPCOM  cumulative  percentages  into 
national  percentile  scores.  Transformation 
curves  were  obtained  by  combining  informa¬ 
tion  from  MEPCOM  and  PAY  samples  in 
grades  11  and  12.  The  average  transforma¬ 
tion  was  then  used  in  10th  grade  to  convert 
MEPCOM  cumulative  percentages  into 
national  percentile  scores. 


-l- 


EXECUTIVE  SUMMARY 


The  Department  of  Defense  (DOD)  uses  the  Armed  Services  Vocational 
Aptitude  Battery  (ASVAB)  to  determine  the  enlistment  eligibility  of 
applicants  for  the  four  military  services.  ASVAB  scores  are  also  used  to 
assign  enlistees  to  military  jobs.  In  addition,  the  ASVAB  is  administered  in 
participating  high  schools  and  postsecondary  schools  as  part  of  the  DOD 
Student  Testing  Program.  It  is  taken  by  over  a  million  students  per  year  in 
over  15,000  schools.  ASVAB  results,  reported  as  percentile  ranks  on  seven 
composites,  are  useful  to  students  and  school  officials  as  a  counseling  resource. 

As  part  of  the  Profile  of  American  Youth  (PAY)  study,  the  ASVAB  was 
administered  in  1980  to  a  nationally  representative  sample  of  16-  to  23-year- 
olds.  This  sample  provided  national  norms  for  the  youth  population  (18-  to 
23-year-olds),  two-year  colleges,  and  high  school  grades  11  and  12. 

In  high  schools,  the  ASVAB  is  administered  in  10th,  11th,  and  12th 
grades.  The  form  currently  used  in  the  Student  Testing  Program  is  ASVAB 
Form  14,  which  was  introduced  in  July  1984.  Until  1986,  national  high  school 
norms  for  Form  14  were  available  for  11th  and  12th  grades  only.  Scores  of 
10th  graders  had  to  be  interpreted  using  11th  grade  norms.  Therefore,  in  a 
special  administration  in  late  1984,  the  Military  Entrance  Processing 
Command  (MEPCOM)  tested  all  students  in  grades  9  through  12  in  52  high 
schools.  Since  participation  by  a  school  was  voluntary,  this  sample  was  not 
nationally  representative.  The  objective  of  the  present  study  was  to  develop 
norms  for  10th  grade  by  combining  information  in  the  PAY  and  MEPCOM 
samples. 

NORMS 

The  problem  in  developing  10th  grade  norms  was  to  estimate  percentile 
ranks  in  a  truly  representative  national  sample  by  using  data  from  the 
nonrandom  MEPCOM  sample.  This  could  be  done  by  adding  information 
about  11th  and  12th  grades  available  in  the  representative  PAY  sample.  The 
two  data  sets  were  used  to  obtain,  for  each  composite  and  sex,  the 
transformation  curve  that  converted  cumulative  percentages  in  the  MEPCOM 
sample  into  percentile  scores  in  the  PAY  sample.  The  curve  was  then  used  to 
calculate  percentile  scores  for  10th  grade  from  score  distributions  in  the 
MEPCOM  sample. 


Use  of  the  transformation  method  requires  the  assumption  that  the 
transformation  is  the  same  in  all  grades.  This  assumption  was  found  to  be 
consistent  with  available  data.  Statistical  tests  showed  that  observed 
differences  between  11th  and  12th  grade  curves  could  be  attributed  to  random 
sampling  error. 

As  an  illustration  of  the  results,  figure  I  shows  percentile  ranks  for 
females  on  the  Academic  Ability  composite  in  all  three  grades.  The  changes 
from  one  grade  to  the  next  appear  reasonable,  not  only  in  this  case,  but  for  all 
composites  and  both  sexes  (see  figures  10  through  23  in  the  main  text). 
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FIG.  I:  NORMS  FOR  FEMALES, 

COMPOSITE  AA 

An  external  check  on  the  methodology  was  made  in  the  following 
manner.  The  Verbal  composite  had  earlier  been  equated  to  a  reading 
achievement  test,  providing  a  conversion  of  Verbal  standard  scores  into 
reading  grade  levels.  Therefore,  norms  for  the  Verbal  composite  could  be 
plotted  with  percentile  ranks  on  the  vertical  axis  as  in  figure  I,  and  grade 
levels  instead  of  standard  scores  on  the  horizontal  axis.  This  was  done  for  the 
total  grade  norms  (i.e.,  with  sexes  combined).  The  percentile  rank  of  grade 
level  10.0  in  10th  grade  was  very  close  to  the  ranks  of  11.0  in  the  11th  grade 


and  12.0  in  the  12th  grade.  Thus,  as  figure  II  shows,  10th  grade  norms 
calculated  in  this  study  are  consistent  with  11th  and  12th  grade  norms 
obtained  directly  from  the  PAY  sample.  This  finding  provides  strong  evidence 
that  the  transformation  method  is  valid. 

The  norms  developed  in  this  study  describe  the  results  that  would  have 
been  obtained  if  10th  graders  had  been  tested  in  the  PAY  study.  They  have 
been  used  to  generate  lOth-grade  score  reports  sent  to  students  and 
counselors.  The  main  text  presents  norm  tables  for  all  composites  in  the 
Student  Testing  Program. 


FIG.  II:  TOTAL  GROUP  NORMS,  VERBAL  COMPOSITE: 
STANOARD  SCORE  CONVERTED  TO  C.  A.T.  GRADE  LEVEL 
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INTRODUCTION 


The  Department  of  Defense  (DOD)  uses  the  Armed  Services  Vocational 
Aptitude  Battery  (ASVAB)  to  determine  the  enlistment  eligibility  of 
applicants  for  the  four  military  services.  ASVAB  scores  are  also  used  to 
assign  enlistees  to  military  jobs.  In  addition,  the  ASVAB  is  administered  in 
participating  high  schools  and  postsecondary  schools  as  part  of  the  DOD 
Student  Testing  Program.  It  is  taken  by  over  a  million  students  per  year  in 
over  15,000  schools.  ASVAB  results  are  useful  to  students  and  school  officials 
as  a  counseling  resource.  Norms  for  the  ASVAB  are  based  on  a  nationally 
representative  sample  tested  in  1980  as  part  of  the  Profile  of  American  Youth 
(PAY)  study  [1]. 

CONTENTS  OF  THE  ASVAB 

The  ASVAB  contains  10  subtests:  General  Science  (GS),  Arithmetic 
Reasoning  (AR),  Word  Knowledge  (WK),  Paragraph  Comprehension  (PC), 
Numerical  Operations  (NO),  Coding  Speed  (CS),  Auto/Shop  Information  (AS), 
Math  Knowledge  (MK),  Mechanical  Comprehension  (MC),  and  Electronics 
Information  (El).  The  Verbal  (VE)  subtest  is  defined  as  the  sum  of  WK  and 
PC.  Two  subtests,  NO  and  CS,  are  tests  of  speed  in  handling  numerical  and 
symbolic  material.  Because  individual  items  in  these  subtests  are  very  easy, 
the  examinee’s  score  depends  primarily  on  the  number  of  items  answered 
within  the  allotted  time.  All  other  subtests  are  power  tests  with  liberal  time 
limits. 

Among  the  power  tests,  Auto/Shop  and  Electronics  Information  require 
specific  information  that  examinees  are  likely  to  have  learned  on  their  own, 
through  reading  and  practical  experience,  rather  than  from  instruction  in 
school.  Mechanical  Comprehension  also  requires  this  type  of  information  in 
addition  to  knowledge  of  basic  physics. 

When  ASVAB  scores  are  reported  to  students  and  counselors,  subtests 
are  combined  into  academic  and  occupational  composites.  The  three  academic 
composites  are  Academic  Ability  (AA),  Verbal  (VBL,  to  be  distinguished  from 
subtest  VE),  and  Mathematics  (MTH).  They  are  useful  in  predicting  a 
student’s  educational  progress  in  areas  requiring  verbal  and  mathematical 
skills.  The  four  occupational  composites  are  Mechanical  and  Crafts  (M&C, 
different  from  subtest  MC),  Business  and  Clerical  (BC),  Electronics  and 


Electrical  (EE),  and  Health,  Social,  and  Technology  (HST).  Scores  on  these 
composites  indicate  a  student’s  aptitude  for  careers  in  different  areas. 

DOD  STUDENT  TESTING  PROGRAM 

The  DOD  Student  Testing  Program  provides  the  ASVAB,  free  of  charge, 
to  participating  high  schools  and  postsecondary  schools.  It  has  two  major 
goals.  One  is  to  help  students  identify  aptitudes  and  plan  their  education  and 
careers.  Toward  this  end,  percentile  scores  on  the  seven  composites  are 
provided  to  students  and  their  counselors.  The  other  goal  is  to  help  DOD 
attract  well-qualified  volunteers.  Therefore,  ASVAB  scores  of  11th  and  12th 
grade  students  are  made  available  to  military  recruiters. 

ASVAB  forms  14a,  14b,  and  14c  are  used  in  schools.  They  are  parallel  to 
Form  8a  which  was  used  in  PAY  [2],  Percentile  scores  reported  to  counselors 
are  based  on  norms  for  the  student’s  grade,  for  grade  and  sex,  and  for  the 
youth  population  (ages  18  through  23).  Scores  reported  to  students  use  norms 
for  their  own  grade  and  sex,  and  for  the  youth  population.  However,  from 
July  1984  to  September  1986,  10th  graders  were  scored  against  11th  grade 
norms  because  10th  grade  norms  were  not  available. 

Norms  for  11th  grade,  12th  grade,  and  postsecondary  schools  are  based 
on  students  in  the  PAY  sample,  which  includes  ages  16  through  23  years.  The 
youth  population  norms  are  based  on  18-  to  23-year  olds  in  this  sample.  In 
combination  with  the  Military  Career  Guide,  published  by  the  DOD  Student 
Testing  Program,  percentile  ranks  based  on  these  norms  help  students 
estimate  their  chances  of  qualifying  for  various  military  occupations. 

MEPCOM  DATA 

Proper  interpretation  of  scores  of  10th  graders  requires  norms  for  this 
grade.  Therefore,  in  1984,  the  Military  Entrance  Processing  Command 
(MEPCOM)  administered  the  ASVAB  to  students  in  grades  9  to  12  in  more 
than  50  schools  that  agreed  to  participate.  Data  for  grades  10  to  12  were  used 
in  this  study. 

Because  participation  by  the  schools  was  voluntary,  the  students  tested 
do  not  constitute  a  nationally  representative  sample.  Therefore,  score  dis¬ 
tributions  from  the  MEPCOM  sample  cannot  provide  national  norms  directly. 
However,  they  can  be  adjusted  by  using  other  available  information,  such  as 


the  national  PAY  sample  available  for  grades  11  and  12.  The  11th  and  12th 
grade  data  in  the  two  samples  were  combined  to  find  a  method  of  obtaining 
national  norms  from  the  MEPCOM  sample.  The  same  method  was  then  used 
in  10th  grade. 


VY 


DATA  AND  METHODOLOGY 


AVAILABLE  DATA  SETS 

The  PAY  data  were  obtained  by  administering  ASVAB  Form  8a  to  a 
nationally  representative  sample  of  11,878  persons  in  the  age  range  of  16  to  23 
[1],  Some  groups,  such  as  Blacks  and  Hispanics,  were  oversampled.  Weights 
based  on  sex,  race,  and  other  variables  were  used  to  make  the  weighted 
sample  match  the  national  population. 

The  ASVAB  forms  used  in  the  DOD  Student  Testing  Program  are  14a, 
14b,  and  14c.  These  have  been  found  to  be  parallel  to  Form  8a  [2],  Therefore 
11th  and  12th  grade  students  in  the  PAY  data  set  could  be  used  to  develop 
high  school  norms  [3].  Unweighted  sample  sizes  were  1,304  for  grade  11  and 
1,253  for  grade  12.  Weights  calculated  in  the  original  study  [1]  were  used 
while  computing  percentile  scores. 

The  MEPCOM  sample  used  in  this  study  consists  of  10th  to  12th  grade 
students  in  52  high  schools  that  accepted  MEPCOM’s  invitation  to  participate 
in  the  study.  In  order  to  avoid  the  sample’s  being  biased  through  student  self¬ 
selection,  the  battery  was  administered  to  every  student  in  school  on  the  day 
of  testing.  The  MEPCOM  sample  is  nonrepresentative  primarily  because  the 
high  schools  were  self-selected;  i.e.,  it  includes  only  those  schools  that  agreed 
to  participate. 

Appendix  A  provides  detailed  information  about  the  data  sets. 
CALCULATION  OF  NORMS 

The  problem  was  to  adjust  results  from  the  nonrandom  MEPCOM 
sample  so  that  the  score  distributions  would  be  equivalent  to  those  from  a 
random  national  sample.  The  First  step  was  to  correct  for  the  oversampling  of 
minorities  in  the  MEPCOM  sample.  This  was  done  by  assigning  weights  to 
individuals  according  to  sex  and  race/ethnicity.  The  weights  were  calculated 
to  ensure  that,  in  each  grade,  the  sex  by  race/ethnicity  proportions  in  the 
weighted  sample  equaled  those  in  the  1980  census  (table  260  in  [6]).  Because 
of  overlap  between  categories,  frequency  of  "Whites-and-others”  was  cal 
culated  as  the  total  minus  frequencies  of  Blacks  and  Hispanics. 


Results  for  grades  11  and  12  showed  that,  while  weighting  reduced  the 
difference  between  PAY  and  MEPCOM  mean  scores,  the  correction  was  far 
from  adequate.  Further  adjustments  were  needed  to  obtain  from  the 
MEPCOM  sample  percentile  scores  that  approximated  those  from  the  PAY 
sample. 

TRANSFORMATION  OF  PERCENTILE  SCORES 

To  develop  grade  norms  from  the  MEPCOM  sample,  the  relationship 
between  this  sample  and  the  national  population  must  be  known.  This 
relationship  must  be  found  from  data  in  grades  11  and  12,  and  then  used  to 
develop  norms  in  lower  grades.  Such  extrapolation  to  lower  grades  requires 
that  the  relationship  be  the  same  in  all  grades  (except  for  sampling  errors). 

With  the  exception  of  the  BC  composite,  MEPCOM  students  tend  to  score 
lower  than  PAY  students.  Such  a  difference  can  be  expressed  in  terms  of 
means  or  medians,  but  this  is  not  enough  for  obtaining  norms.  Percentile 
ranks  are  to  be  calculated  for  all  standard  scores.  Therefore,  an  entire 
MEPCOM  distribution  must  be  related  to  the  corresponding  PAY  distribution 
in  a  manner  that  does  not  require  assumptions  about  the  distributions  (e.g., 
normality). 

A  percentile  score  shows  an  individual  examinee’s  position  relative  to 
the  national  population.  When  a  group  of  examinees  is  to  be  described,  a 
complete  description  of  its  performance  relative  to  the  national  population  is 
provided  by  its  distribution  of  percentile  scores.  Therefore,  if  the  distribution 
of  percentile  ranks  in  the  MEPCOM  sample  is  the  same  in  all  grades,  its 
relationship  to  the  national  population  is  grade  invariant.  This  relationship 
can  be  found  from  11th  and  12th  grade  data  and  used  to  compute  norms  for 
10th  grade.  (It  does  not  matter  if  the  relationship  varies  with  sex  or 
composite.) 

In  this  report,  the  generic  term  "cumulative  percentage”  will  refer  to 
values  obtained  from  a  MEPCOM  sample.  Cumulative  percentages  in  a 
national  sample  will  be  called  "percentile  ranks”  or  "percentile  scores” 
because  they  are  printed  in  score  reports.  For  grades  11  and  12,  these  are 
obtained  directly  from  the  PAY  sample;  for  grade  10  they  are  estimates 
calculated  in  this  study. 


For  present  purposes,  the  best  way  to  display  a  distribution  is  to  plot 
cumulative  percentages.  Figure  1  shows  such  a  plot  for  composite  AA,  using 
data  from  females  in  grades  11  and  12;  the  PAY  percentile  score  is  on  the  Y 
axis  and  corresponding  cumulative  percentage  in  the  MEPCOM  sample  is  on 
the  X  axis.  The  two  curves  are  very  close  together,  which  indicates  that  the 
assumption  of  grade  invariance  is  correct.  These  curves  can  be  used  to  trans 
form  MEPCOM  cumulative  percentages  into  national  percentile  scores. 


MEPCOM  percentage 

FIG.  1:  TRANSFORMATIONS  FOR  COMPOSITE  AA 
(FEMALE  SAMPLE) 


Figure  1  contains  an  illustration  of  the  transformation  method.  For  a 
standard  score  of  46,  the  cumulative  MEPCOM  percentage  in  grade  10  was 
65.0.  In  figure  1,  this  value  is  represented  by  the  vertical  line.  It  intersects 
the  solid  curve  (grade  12)  at  a  percentile  score  of  61.9  and  the  dashed  curve 
(grade  11)  at  a  percentile  score  of  59.2.  These  are  the  estimates  of  the 
10th  grade  percentile  score  corresponding  to  the  standard  score  of  46,  based  on 
transformations  obtained  from  12th  and  11th  grades.  According  to  a 
statistical  test  described  later,  the  difference  between  the  two  values  is  due  to 
sampling  fluctuations.  It  appears  in  figure  1  as  the  vertical  distance  between 
the  two  curves. 

The  basic  transformation  method  illustrated  in  figure  1  was  refined  to 
reduce  sampling  errors.  For  each  integer  value  of  the  MEPCOM  cumulative 
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percentage,  the  mean  percentile  rank  in  grades  11  and  12  was  calculated;  i.e., 
the  two  curves  in  figure  1  were  averaged.  The  averaged  curve  was  then 
smoothed,  using  a  five-point  rolling  average.  (Appendix  B  gives  details  of  this 
procedure.)  Figure  2  shows  the  smoothed  transformation  for  Academic 
Ability  in  the  female  sample.  It  yields  the  10th  grade  percentile  rank  for  the 
standard  score  of  46  as  60.8,  which  becomes  61  after  rounding. 
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FIG.  2:  USE  OF  AVERAGED  SMOOTHED 
TRANSFORMATION 

The  transformation  method  for  estimating  norms  is  robust  in  the  sense 
that  it  does  not  involve  any  assumptions  about  the  way  in  which  PAY  and 
MEPCOM  samples  differ.  For  instance,  MEPCOM  students  were  tested  later 
in  the  year  than  those  in  the  PAY  sample.  However,  as  long  as  any  such 
influence  operates  in  all  grades,  the  assumption  of  grade-invariant 
transformation  remains  valid.  Therefore,  the  norms  calculated  in  this  study 
describe  the  results  that  would  have  been  obtained  if  10th  graders  had  been 
tested  in  the  PAY  study. 


TESTING  GRADE  INVARIANCE 


Because  PAY  data  are  available  for  two  grades,  it  is  possible  to  test  the 
assumption  that,  for  any  given  composite  and  sex,  the  transformation  from 
MEPCOM  cumulative  percentage  to  the  PAY  percentile  score  is  grade  in¬ 
variant.  As  figure  1  illustrates,  the  transformations  obtained  from  grades  11 
and  12  are  bound  to  differ  due  to  sampling  errors.  The  question  is  whether 
observed  differences  are  small  enough  to  be  attributed  to  random  error. 

Since  different  composites  are  correlated,  comparisons  of  their  trans¬ 
formation  curves  are  not  independent.  Therefore,  a  multivariate  chi-square 
test  was  developed.  This  test,  which  assumes  composite  scores  to  be  normally 
distributed,  takes  correlations  into  account.  Appendix  B  presents  a  detailed 
description  of  the  test.  The  test  showed  that  differences  between  11th  and 
12th  grades  were  statistically  nonsignificant. 

Since  the  data  support  the  assumption  of  grade  invariance,  trans¬ 
formations  from  11th  and  12th  grades  can  be  averaged  and  used  to  compute 
percentile  scores  in  lower  grades. 


RESULTS 


DATA  EDITING 

The  researchers  dropped  5  of  the  52  MEPCOM  schools:  In  3  schools,  data 
were  missing  in  one  or  more  grade,  and  in  2  others,  the  number  of  students 
tested  was  much  smaller  than  normal  attendance  rate.  In  addition,  the  study 
dropped  246  individual  students  because  they  had  left  all  items  blank  on  one 
or  more  subtest.  Table  1  shows  the  composition  of  the  edited  MEPCOM 
sample.  While  the  sample  size  drops  as  grade  increases,  it  remains  more  than 
twice  as  large  as  the  PAY  sample  size.  As  in  the  PAY  sample.  Blacks  and 
Hispanics  were  oversampled.  Appendix  A  gives  details  of  the  data  checking 
and  editing. 

TABLE  1 

COMPOSITION  OF  EDITED  MEPCOM  SAMPLE 


Percent 


Grade 

N 

Black 

Hispanic 

Female 

10 

3,878 

17.3 

10  2 

50  4 

1 1 

3,263 

18  6 

9.1 

50.3 

12 

2,682 

17  2 

82 

51  4 

Because  of  the  oversampling  of  minorities,  the  study  used  a  weighted 
sample  to  calculate  score  distributions  leading  to  the  norms.  For  each  grade 
and  sex,  a  weight  was  calculated  for  each  population  group  (Black,  Hispanic, 
White-and-others)  so  that  the  proportion  of  each  group  by  sex  combination  in 
the  weighted  sample  equaled  that  in  the  1980  census.  The  weights  changed 
slightly  with  grade.  Table  2  presents  their  values. 

NORMS 

The  test  for  grade  invariance  of  transformation  curves  yields  chi-square 
statistics  with  14  degrees  of  freedom.  The  chi-square  values  were  17.5  for 


males  and  19.2  for  females;  the  corresponding  tail  probabilities  were  .23  and 
.16.  Thus,  observed  differences  between  11th  and  12th  grade  transformation 
curves  are  not  statistically  significant. 

TABLE  2 


WEIGHTS  FOR  SUBGROUPS  IN  THE  MEPCOM  SAMPLE 


Grade 

Male 

Female 

White 

Black 

Hispanic 

White 

Black 

Hispanic 

10 

1  07 

0  88 

0  95 

1.07 

0  88 

0  58 

1 1 

1  06 

0  81 

114 

1.12 

0.77 

0  55 

12 

1  06 

0  88 

1  07 

1  07 

0.77 

0  66 

Figures  3  through  9  show  the  averaged,  smoothed  transformation 
curves.  (Figure  2  illustrates  their  use.)  Most  of  these  curves  are  below  the  45- 
degree  line,  which  means  that  MEPCOM  students  tended  to  score  lower  than 
PAY  students.  One  major  exception  is  the  Business  and  Clerical  composite, 
which  contains  the  Coding  Speed  subtest.  Because  students  were  tested  in 
large  groups,  time  limits  for  speed  tests  could  not  be  strictly  enforced; 
therefore,  scores  on  these  subtests  may  be  somewhat  inflated  [7], 

Tables  3  through  9  present  10th  grade  norms  for  the  seven  composites. 
Figures  10  through  23  graphically  show  norms  for  all  three  grades.  The 
curves  show  smooth  and  gradual  changes  from  one  grade  to  another, 
indicating  that  the  transformation  method  has  worked  satisfactorily.  (Norms 
for  grades  11  and  12  are  taken  from  [3].) 

Note  that  the  transformation  corrects  for  all  sources  of  differences 
between  MEPCOM  and  PAY  samples.  In  addition  to  differences  in  ability 
levels,  this  includes  disturbances  such  as  nonstandard  administration  and 
variations  in  the  date  of  testing.  The  only  condition  is  that  the  effect  of  such 
disturbances  be  the  same  on  all  grades  in  any  given  school,  hence  the  same  on 
all  grades  in  the  MEPCOM  sample  as  a  whole.  The  chi-square  test  shows  that 
this  condition  was  satisfied.  Hence,  although  testing  dates  in  the  MEPCOM 
sample  were  spread  over  4  months,  the  10th  grade  norms  correspond  to  testing 
at  the  same  time  of  the  year  as  PAY  did,  i.e.,  duringsummer. 
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FIG.  6:  TRANSFORMATION  CURVES  FOR 
COMPOSITE  M&C 
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FIG.  7 
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FIG.  8:  TRANSFORMATION  CURVES  FOR 
COMPOSITE  EE 


100 


MEPCOM  percentage 

FIG.  9:  TRANSFORMATION  CURVES  FOR 
COMPOSITE  HST 


EXTERNAL  CHECK 

The  chi-square  test  provided  an  internal  check  on  the  transformation 
method.  An  external  check  was  also  made.  The  ASVAB  Verbal  composite  has 
been  equated  to  the  California  Achievement  Test  (C.A.T.)  Reading  Total.  The 
equating  table  converts  each  Verbal  standard  score  into  a  reading  grade  level. 
Therefore,  the  Verbal  norms  can  be  displayed  by  plotting  percentile  scores 
against  grade  levels.  Figure  24  shows  total  group  norms  in  this  manner.  (The 
equating  table  was  smoothed  by  fitting  grade  level  as  a  fifth-degree  poly¬ 
nomial  of  the  ASVAB  score.) 


m 


If  I0th  grade  norms  derived  in  this  study  are  correct,  they  should  show 
consistency  with  11th  and  12th  grade  norms  obtained  directly  from  the  PAY 
sample.  Therefore,  figure  24  has  vertical  lines  at  grade  levels  of  10.0,  11.0, 
and  12.0  up  to  the  point  where  they  meet  the  curves  for  the  corresponding 
grades.  Ideally,  the  intersections  should  occur  at  the  same  percentile  score  for 
all  grades.  (This  percentile  score  should  be  50  because,  by  definition,  the 
grade  level  10.0  is  the  median  of  grade  10,  etc.) 
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FIG.  14.  NORMS  FOR  MALES,  COMPOSITE  MTH 
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FIG.  15:  NORMS  FOR  FEMALES,  COMPOSITE  MTH 
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Figure  24  shows  that  the  vertical  lines  intersect  the  norm  curves  at 
almost  but  not  exactly  the  same  values:  42  for  grade  10,  44  for  grade  11,  and 
43  for  grade  12.  The  differences  are  well  within  sampling  errors.  (Note  that 
norms  for  grade  10  are  derived  from  five  distinct  samples,  with  effective  PAY 
sample  sizes  being  below  900  per  grade.1  Additional  random  error  enters 
through  the  equating  of  ASVAB  to  C.A.T.)  The  departure  from  the  ideal 
value  of  50  implies  that  the  norming  samples  for  C.A.T.  were  not  nationally 
representative. 


FIG.  24:  TOTAL  GROUP  NORMS,  VERBAL  COMPOSITE: 
STANDARD  SCORE  CONVERTED  TO  C.  A.T.  GRADE  LEVEL 


1.  For  any  given  composite,  grade  10  norms  are  based  on  the  MEPCOM  grade  10  sample 
and  the  transformation  curve.  The  transformation  is  calculated  from  PAY  grades  1 1  and 
12  and  MEPCOM  grades  11  and  12. 
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APPENDIX  A 


DETAILED  DESCRIPTION  OF  DATA  USED 


INTRODUCTION 

Two  sets  of  data  were  used  in  developing  national  Armed  Services 
Vocational  Aptitude  Battery  (ASVAB)  norms  for  10th  grade  students  for 
seven  composites  of  ASVAB  subtests.  These  sets  were  (1)  the  1980  national 
sample  tested  as  part  of  the  Profile  of  American  Youth  (PAY)  study  [A-l],  and 
(2)  results  from  students  at  selected  high  schools  who  were  tested  by  the 
Military  Entrance  Processing  Command  (MEPCOM)  from  September  1984  to 
January  1985. 

PAY  DATA 

The  ASVAB  was  administered  during  the  summer  of  1980  to  a 
nationally  representative  sample  of  11,914  men  and  women,  born  during  1957 
through  1964.  All  but  203  people  in  this  sample  were  interviewed  in 
April  1980  to  get  information  such  as  the  grade  in  school  in  which  they  were 
currently  enrolled.  Since  this  information  was  necessary  to  better  define  the 
sample,  these  203  records  were  removed.  Also  edited  out  were  36  records  of 
people  who  were  administered  the  test  in  a  nonstandard  way. 

PAY  1 1th  and  12th  Grade  Sample -Selection  1 

From  the  remaining  sample,  students  were  identified  as  11th  graders 
and  12th  graders  by  using  the  interview  question:  "What  grade  or  year  of 
regular  school  are  you  attending  or  enrolled  in?”  [A-2],  If  the  response  was 
"10,”  the  student  was  flagged  as  an  11th  grader;  if  the  response  was  "11,”  the 
student  was  flagged  as  a  12th  grader. 

Justification  for  this  selection  is  as  follows,  by  the  summer  of  1980,  most 
students  flagged  as  11th  graders  would  have  passed  the  10th  grade  and  would 
have  been  ready  to  start  the  11th  grade  when  tested  in  the  PAY  study.  The 
word  "most”  is  used  because  researchers  had  no  way  of  identifying  students 
who  were  not  promoted  to  the  11th  grade  either  because  of  failing  and/or 
dropping  out  after  the  April  interview.  Justification  for  the  selection  of 
students  flagged  as  12th  graders  follows  a  parallel  line  of  reasoning.  This 
manner  of  identifying  11th  and  12th  graders  will  be  referred  to  as  "PAY 
selection  1.” 


PAY  11th  and  12th  Grade  Sample  -  Selection  2 

An  additional  27  students  were  included  as  11th  graders  and  37  students 
as  12th  graders  by  using  the  following  two  additional  interview  questions: 

(1) ,rVVhat  is  the  highest  grade  of  regular  school  you  have  ever  attended?”  and 

(2) ”When  were  you  last  enrolled  in  regular  school  (month  and  year)?” 
Students  who  responded  with  ”10”  to  question  1  and  a  date  during  the  period 
of  December  1979  through  April  1980  to  question  2  were  included  as 
11th  graders.  Students  who  responded  with  ”11”  to  question  1  and  a  date 
during  the  period  of  December  1979  through  April  1980  to  question  2  were 
included  as  12th  graders.  In  other  words,  students  who  dropped  out  of 
10th  grade  after  November  are  included  in  this  selection  as  11th  graders  and 
similar  11th  grade  dropouts  are  included  as  12th  graders. 

Current  11th  and  12th  grade  norms  were  developed  by  the  Air  Force 
Human  Resources  Laboratory  for  the  seven  composites  using  this  selection. 
Therefore,  this  selection  was  used  in  this  study  as  well.  This  manner  of  identi¬ 
fying  11th  and  12th  grade  students  will  be  referred  to  as  "PAY  selection  2.” 
PAY  selection  1  and  PAY  selection  2  are  identical  except  for  the  inclusion  of 
the  27  extra  11th  graders  and  37  extra  12th  graders  in  PAY  selection  2. 

Weighting 

The  PAY  data  were  weighted  to  reflect  the  1980  population  by  age, 
gender,  and  race/ethnic  groups.  Norms  were  developed,  based  on  weighted 
samples.  Speeded  test  scores  were  adjusted  according  to  the  results  of  Wegner 
and  Ree  [A-3].  Table  A- 1  shows  the  unweighted  and  weighted  sample  sizes  for 
PAY  selection  1.  Table  A-2  shows  the  unweighted  and  weighted  sample  sizes 
for  PAY  selection  2. 

MEPCOM  DATA 

The  data  from  MEPCOM  included  records  from  15,247  students  tested  in 
52  schools.  To  eliminate  substandard  data,  two  basic  types  of  editing  were 
done:  (1)  editing  of  entire  schools,  and  (2)  editing  of  individuals  from  the 
acceptable  schools.  In  addition,  ninth  grade  records  were  not  used  in  this 
study. 


TABLE  A-1 


PAY  SELECTION  1 

Grade  1 1-unweighted  Grade  1 1-weighted 

Sample  Frequency  Percent  Frequency  Percent 


Male 

662 

51.8 

2,090,598 

51.0 

Female 

615 

48.2 

2,007,039 

49  0 

Black 

348 

27  3 

583,228 

14.2 

Hispanic 

218 

17.1 

259,625 

6  3 

White 

71 1 

55.7 

3,254,785 

79  4 

Total 

1,277 

4,097,638 

Grade  12-unweighted 

Grade  12-weighted 

Sample 

Frequency 

Percent 

Frequency 

Percent 

Male 

622 

51.2 

1,773,448 

51.3 

Female 

594 

48.8 

1,68 2,322 

48  7 

TABLE  A-2 


PAY  SELECTION  2 


Sample 

Grade  1 1 -unweighted 

Grade  11-weighted 

Frequency 

Percent 

Frequency 

Percent 

Male 

680 

52  1 

2,133,112 

51  2 

Female 

624 

47  9 

2,035,396 

48  8 

Black 

354 

27  1 

593,463 

14  2 

Hispanic 

225 

17  3 

266,960 

6  4 

White 

725 

55  6 

3,308,085 

79  4 

Total 

1,304 

4,168,508 

Sample 

Grade  12-unweighted 

Grade  12-weighted 

Frequency 

Percent 

Frequency 

Percent 

Male 

642 

51.2 

1,814,133 

512 

Female 

61 1 

48  8 

1,726,571 

48  8 

Black 

355 

28.3 

512,166 

14.5 

Hispanic 

234 

18.7 

232,928 

6  6 

White 

664 

53.0 

2,795,61 1 

79  0 

Total 

1,253 

3,540,704 
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Editing  of  Schools 

The  MEPCOM  test  administrators  were  instructed  to  test  all  students 
present  on  the  day  of  testing  in  each  school  so  that,  within  each  school,  there 
would  be  no  self-selection.  This  absence  of  self-selection  is  essential  for 
avoiding  biased  samples.  The  most  recent  enrollment  figures  available  at  the 
United  States  Department  of  Education’s  National  Center  for  Education 
Statistics  [A-4  through  A-8]  were  used  as  the  primary  sources  for  determining 
whether  a  sufficient  number  of  students  were  tested.  Two  schools  were  edited 
out  because  their  percentages  of  students  tested  fell  below  70. 

One  additional  school  was  rejected  because  an  abnormally  low  per¬ 
centage  of  12th  graders  was  tested,  even  though  the  overall  percentage  was 
acceptable.  This  smaller  proportion  of  12th  graders  could  represent  a  selec¬ 
tion  of  the  least  able  (or  most  able)  students  in  that  grade,  thus  might  not 
accurately  reflect  the  proper  progression  of  score  distributions  from  10th 
grade  through  12th  grade  in  that  school. 

Two  schools  were  deleted  because  they  lacked  results  from  at  least  one 
entire  grade.  With  a  grade  missing,  the  10th  through  12th  grade  progression 
could  not  be  determined.  A  total  of  47  schools  in  18  states  in  all  4  regions  of 
the  United  States  (Northeast.  Southeast,  Midwest,  and  West)  remained  after 
editing.  Figure  A- 1  shows  the  approximate  locations  of  these  47  schools. 

The  date  of  testing  was  examined  for  these  47  schools.  Test  dates  ranged 
from  28  September  1984  to  18  January  1985.  All  students  were  tested  on  the 
same  date  in  44  of  the  47  schools.  The  other  3  schools  tested  on  two  dates 
separated  by  1  day,  10  days,  and  38  days.  For  the  school  with  the  gap  of 
38  days,  the  distributions  of  grade,  gender,  and  race/ethnic  group  were 
checked.  These  distributions  were  found  to  be  similar  for  the  two  testing 
sessions. 

Editing  of  Individuals 

In  addition  to  the  test  results,  MEPCOM  gathered  other  information, 
including  the  race,  ethnic  background  of  each  student.  Thirty-four  students 
were  labeled  "unknown”  on  race  ethnicity.  They  were  removed  because  this 
information  was  necessary  in  matching  the  census  percentages  when 
weighting  the  MEPCOM  schools.  An  additional  21  individuals  were  deleted 
because  their  grades  were  unknown. 


The  study  assumed  that  students  who  did  not  take  the  test  seriously 
would  cause  the  results  to  become  distorted.  Researchers  expected  some  zero 
scores  to  occur  by  chance.  However,  if  an  individual  omitted  every  item  on  one 
subtest,  serious  doubts  were  raised  as  to  the  student’s  effort  on  all  the  sub¬ 
tests.  Thus,  the  entire  record  was  removed  if  a  student  omitted  all  items  on 
one  or  more  subtest.  When  these  records  were  deleted,  the  proportion  of  zero 
scores  was  comparable  to  that  in  the  PAY  data. 

Finally,  17  records  were  deleted  because  the  individuals  were  entered 
twice  on  the  MEPCOM  data  tape. 

Edited  MEPCOM  Sample 

After  editing,  14,061  of  the  original  15,252  cases  remained.  The  cases 
that  were  edited  out  fell  into  five  basic  categories:  (1)  unacceptable  school, 
(2)  unknown  race/ethnic  group,  (3)  unknown  grade,  (4)  all  omits  on  any  sub¬ 
test,  and  (5)  duplicated  record.  Twenty-one  of  the  cases  fell  into  two  of  these 
five  categories,  and  the  other  1,170  cases  fell  into  only  one  of  the  categories. 
Table  A-3  provides  further  information  concerning  the  number  of  cases  edited 
out. 


TABLE  A-3 

NUMBER  OF  CASES  EDITED  OUT 

Reason  for  editing  Number  edited  out 

Unaccceptable  school 
Unknown  race/ethnic  group 
Unknown  grade 
All  omits  on  any  subtest 
Duplicated  record 

Cases  falling  into  2  categories 
Total 


At  the  end  of  this  process  ninth  graders  were  dropped,  leaving 
9,823  students  in  the  data  set  used  in  the  study.  Final  weighting  of  this 
sample  will  reflect  many  considerations,  including  the  gender  and  race/ 
ethnicity  percentages  in  the  1980  census.  Table  A-4  shows  frequencies  for  the 
edited,  unweighted  MEPCOM  sample. 


876 

34 

21 

264 

17 

1,212 
-  21 
1,191 


TABLE  A-4 

EDITED  MEPCOM  SAMPLE 


Sample 


Frequency 


Percentage 
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APPENDIX  B 


DETAILS  OF  METHODOLOGY 


TRANSFORMATION  METHOD 
Steps  in  the  Calculations 

All  calculations  are  performed  independently  for  each  composite  and  sex. 
The  steps  in  the  calculations  are  the  following: 

1.  Compute  frequency  distributions  in  weighted  PAY  and  MEPCOM 
samples.  If  a  score  has  zero  frequency,  assign  a  nonzero  frequency  by 
linear  interpolation  of  the  cumulative  frequency.  (This  is  necessary 
for  avoiding  divisions  by  zero  in  step  o.) 

2.  For  each  composite  score,  calculate  the  percentile  score  from  the  PAY 
sample  and  cumulative  percentage  in  the  MEPCOM  sample.  This 
yields  61  points,  i.e.,  pairs  of  values. 

3.  Use  linear  interpolation  between  successive  points  to  calculate 
percentile  scores  corresponding  to  integer  values  of  MEPCOM  cumu 
lative  percentages. 

4.  For  each  integer  value  of  MEPCOM  percentage,  compute  the 
weighted  mean  of  the  two  values  obtained  from  the  two  grades.  This 
yields  the  average  transformation  curve.  The  weights  for  grades  11 
and  12,  calculated  to  reflect  their  sample  sizes,  were  .53  and  .47  for 
males,  and  .52  and  .48  for  females. 

5.  At  percentage  values  from  2  to  99,  subtract  the  previous  percentile 
score.  The  resulting  differences  are  equivalent  to  frequencies  in  a 
distribution. 

6.  Smooth  these  frequencies,  using  a  five-point  moving  average.  The 
coefficients  are  —3/35,  12/35,  17/35,  12/35,  and  —3/35  (page  516  of 
[B-l]).  For  percentages  2  and  98,  where  five  points  are  not  available, 
use  a  three-point  rolling  average  with  weights  1/4, 1/2,  and  1/4. 

7.  Accumulate  the  recomputed  frequencies  to  obtain  the  smoothed 
transformation. 


8.  In  a  lower  grade  (e.g.,  10th),  smooth  the  MEPCOM  frequency  dis¬ 
tributions  and  calculate  the  cumulative  percentage  of  each  composite 
score.  Using  linear  interpolation,  find  the  corresponding  percentile 
score  from  the  smoothed  transformation  curve.  The  resulting  value  is 
the  desired  estimate  of  the  percentile  score  in  the  national  popula¬ 
tion.  (This  step  is  illustrated  in  figure  2  of  the  main  text.) 

Percentile  score  in  the  total  population  is  the  weighted  average  of  values 
for  the  two  sexes,  the  weights  being  the  proportions  of  the  sexes  in  the  1980 
census. 

Similarities  to  Equating 

PAY  percentile  scores  and  MEPCOM  cumulative  percentages  corre¬ 
spond  to  scores  on  old  and  new  forms,  respectively.  The  transformation  curve 
yields  the  conversion  from  the  new  form  to  the  old  one.  Each  grade  is  a 
different  population.  The  assumption  that  the  transformation  is  the  same  in 
all  grades  is  equivalent  to  the  assumption  that  equating  is  independent  of  the 
population  from  which  data  were  collected. 

CHI-SQUARE  TEST 

One  needs  to  assume  that  composite  scores  have  a  multivariate  normal 
distribution.  Analyses  for  the  two  sexes  were  performed  independently,  and 
effective  sample  sizes  were  used  for  all  samples.  Effective  sizes  of  PAY 
samples  were  taken  from  table  27  in  [B-2].  Those  for  MEPCOM  samples  were 
calculated  from  variances  of  weights  (page  39  of  [B-3]).  Design  effect  for 
MEPCOM  samples  did  not  exceed  1.05. 

Let  X  be  a  composite  score,  and  z^i  the  corresponding  standard  score  in 
the  MEPCOM  grade  11  population.  They  are  related  by 


Ev 


/  V 

>  A  A  . 


where  subscripts  M  and  1  represent  MEPCOM  and  grade  11,  respectively.  A 
similar  equation  holds  for  the  PAY  (i.e.,  national)  population.  Therefore,  the 
MEPCOM  and  PAY  standard  scores  corresponding  to  the  same  composite 
score  are  related  by 


2.Vl  (°.W1  2.Vfl  H"  ^.Vl,/o.Vl 


When  all  distributions  are  normal,  this  defines  the  relationship  between  the 
PAY  percentile  scores  and  the  MEPCOM  cumulative  percentages,  i.e.,  the 
transformation  curve  obtained  from  grade  11  populations.  If  the  trans¬ 
formation  curve  is  grade  invariant,  the  relationship  between  z  scores  must  be 
the  same  in  grade  12.  This  requirement  gives  us  two  conditions  corresponding 
to  the  linear  and  constant  terms  in  the  equation.  The  linear  term  yields 
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The  condition  obtained  from  the  constant  term  can  be  expressed  in  two  ways: 
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or 


OW2^.vn-^.Vl)-OW2(^f2-^.V>)  =  0 


These  equations  are  equivalent  if  (B-l)  holds.  They  were  added  to  maintain 
symmetry  between  PAY  and  MEPCOM  quantities.  Thus,  the  second 
condition  is 
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When  sample  values  replace  parameters  in  equations  ( B- 1. )  and  (B-2), 
the  left-hand  sides  do  not  vanish.  Denote  their  values  by  dcp,  where  c  = 
1,2, 7  indicates  the  composite  and  e  =  1  or  2  indicates  the  equation  from 
which  the  difference  was  obtained.  A  test  must  be  performed  to  determine 
whether  the  14  observed  values  are,  as  a  group,  significantly  different  from 
zero. 

The  sampling  distribution  of  mean  scores  is  normal.  So  is  that  of  sample 
standard  deviations,  to  a  very  good  approximation,  when  each  sample  is  large. 
Each  d  contains  quantities  from  four  samples.  Statistics  obtained  from 
different  samples  are  independent.  Since  normality  has  been  assumed,  means 
and  standard  deviations  are  independent.  However,  means  of  different 
composites  are  correlated  and  so  are  their  standard  deviations.  With  A”  and  s 
the  usual  symbols  for  sample  mean  and  standard  deviation. 


and 


VariX  )  =  o -IN 

c  c 

Coui  X  ,  X  .)  =  a  .IN, 
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2 

where  N  is  the  sample  size  and  ac  ,  occ ■  are  population  variance  and  covariance 
[B-4], 

Corresponding  results  for  standard  deviations  require  first-order  Taylor 
expansion,  which  is  valid  when  the  sample  is  large.  If 

2  2 
s  =  o  •+•  e 
c  c  c 

where  ec  is  the  sampling  error  in  the  estimated  variance, 


CoL'I.s  ,  s  . )  =  Lov  (s~  /  2a  ,s~./2o  ) 
c  c  c  c  c  c 


=  1 1/4  o  o  )  2o  ~  J  N 

c  c  cc 


o  p  ./2N  . 

cc  cc 


where  pcc-  is  the  correlation  between  composites  c  and  c' .  These  formulas 
remain  valid  when  c  —  c'  [B-4], 

The  variance-covariance  matrix  of  the  ds  can  be  calculated  from  these 
basic  formulas.  (The  resulting  expressions  are  too  complicated  to  be  reported 
here.)  Let  S  be  the  estimated  14  x  14  matrix  obtained  by  replacing 
parameters  with  their  sample  estimates.  Let  d  be  the  vector  of  observed 
differences.  The  test  statistic  is  d'S~ld.  Its  asymptotic  distribution  under  the 
null  hypothesis  is  chi-square  with  14  degrees  of  freedom. 

The  chi-square  statistics  were  17.5  for  males  and  19.2  for  females.  The 
corresponding  tail  probabilities,  obtained  from  the  SAS  package  [B-5],  are  .23 
and  .16.  Thus,  the  observed  differences  between  11th  and  12th  grade  trans¬ 
formation  curves  are  not  statistically  significant. 
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APPENDIX  C 


ADDITIONAL  RESULTS 


Figures  C-l  through  C-14  present  unsmoothed  transformation  curves 
obtained  from  grades  11  and  12.  They  show  consistent  patterns.  For  boys,  the 
1 1th  grade  curves  lie  above  the  12th  grade  curves.  This  means  that  MEPCOM 
boys  fell  further  behind  those  in  the  PAY  sample.  The  case  with  girls  is  just 
the  opposite:  The  12th  grade  curve  is  higher  (although  by  a  smaller  amount). 
As  noted  earlier,  grade  differences  between  transformations  are  not 
statistically  significant;,  hence  can  be  attributed  to  sampling  fluctations.  The 
major  part  of  random  error  came  from  the  PAY  sample,  which  was  much 
smaller  than  the  MEPCOM  sample  (especially  in  terms  of  effective  sample 
sizes  after  weighting). 

With  either  sex,  the  difference  between  11th  and  12th  grade  trans¬ 
formations  looks  the  same  for  all  composites.  This  reflects  the  fact  that  the 
composites  are  strongly  correlated. 
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FIG.  C-1: 
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FIG.  C-2:  TRANSFORMATIONS  FOR  COMPOSITE  AA 
(FEMALE  SAMPLE) 
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FIG.  C-3:  TRANSFORMATIONS  FOR  COMPOSITE  VBL 
(MALE  SAMPLE) 


MEPCOM  percentage 


FIG.  C-4:  TRANSFORMATIONS  FOR  COMPOSITE  VBL 
(FEMALE  SAMPLE) 
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FIG.  C-5:  TRANSFORMATIONS  FOR  COMPOSITE  MTH 
(MALE  SAMPLE) 
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FIG.  C-6:  TRANSFORMATIONS  FOR  COMPOSITE  MTH 
(FEMALE  SAMPLE) 
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FIG.  C-7:  TRANSFORMATIONS  FOR  COMPOSITE  M&C 
(MALE  SAMPLE) 
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FIG.  C-8:  TRANSFORMATIONS  FOR  COMPOSITE  M&C 
(FEMALE  SAMPLE) 
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FIG.  C-9:  TRANSFORMATIONS  FOR  COMPOSITE  BC 
(MALE  SAMPLE) 
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FIG.  C-10:  TRANSFORMATIONS  FOR  COMPOSITE  BC 
(FEMALE  SAMPLE) 
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FIG.  C-11: 
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TRANSFORMATIONS  FOR  COMPOSITE  EE 
{MALE  SAMPLE) 
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FIG.  C-12:  TRANSFORMATIONS  FOR  COMPOSITE  EE 
(FEMALE  SAMPLE) 
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FIG.  C-13:  TRANSFORMATIONS  FOR  COMPOSITE  HST 
(MALE  SAMPLE) 
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FIG.  C-1 4:  TRANSFORMATIONS  FOR  COMPOSITE  HST 
(FEMALE  SAMPLE) 
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